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AMENDMENTS TO THE CI.AIMS 

ricasc amend claims 1, 14-16. 18, 22-38 and cancel claims 9^1 1 and 17 as follows. This listing 
of claims will replace all prior versions, and listings, of claims in the application. 

1 . (Currently Amended) In a system for editing an audiovisual work, a method for producing a 
retiming effect on a clip of synchronised audio data and video data, wherein the audio data 
r^nmpngog a Rcqtienc c of audio samples wherein ea ch audio sample has a corresponding; input 
<^[mtj^miH wherein the vide o data comprises a sequence of vid eo samples wherein each video 
^!2}Jlln,b/l^AcQ''''g^PQ ^ding input time, to produce a retimed clip of synchronized audio data and 
video data in the audiovisual wor k, wherein in the retimed clip th e audio data comprises a 
seq uence o F audio samples wherein each audio saiTiple ha s a corresponding output time, and 
whcMfjjiihc^^ a sequence of video samples wherein each video sample has a 

corresponding oil^^ comprising: 

associating a definition of a retiming function for a rampable retiming effect that maps 
output times to input times with the clip of synchronized audio data and video data; 

processing the synchronized audio data and video data according to the retiming fimction 
to produce the retimed clip, wherein processing comprises: 
for each output time for an audio sample, 

determining a corresponding input time from the output time and using the 
retiming function; and 

computing an output audio sample at for the output time b ase d on at l e ast4h e 
audi€Klat^a4H4h^eighb orhood of the corresponding input time u s ing a by applying ^n 
aucliojcsampling function to a plurality of input audio samp les from points in time 
su riniiiidin^ input time, wherein the audio resam pling function 

combin es informa tion fr om the plurality of input audio samples to p roduce the output 
audjo sa mple ; and 

for each output time for a video sample, 
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determining a corresponding input time from the output time md using the 
retiming function, such that input times determined for output times for video samples 
correspond to input times determined for the same output times for audio samples; and 

computing an output video sample at for the output time based onotloaot the 
vj^ee^at{H<»4he-Reighhe ihood of the o un o o ponding input time uoing by applyinR a video 
resampling function to a plurality of input video samoles from points in time surrounding 
jhg cpirespo nding input time, wherein the vide o resampling function combines 
in formatio n from the plurality of input video sam p les to produce the output video samplp . 

2. (Original) The method of claim 1 , v/hcrein the retiming function is defined as a speed curve, 
and whcj cin the speed curve is integrated to determine the input times from output times for both 
video data and audio data, wherein a step size used to compute an integral of the speed curve is 
less than or equal to a step size corresponding to a sampling rate of the audio data. 

I 

3 . (Original) ^I'he method of claim 1 , wherein determining the output audio sample uses a 
lime-scaling function. 

4. (Original) The method of claim 3, wherein determining the output video sample uses 
motion based interpolation. 

5. (Original) The method of claim 3, wherein determining the output video sample uses 
blended frames, 

6. (Original) 1 he method of claim 1 , wherein determining the output audio sample uses a 
resampling function with pitch shifting. 

7. (Original) The method of claim 6, wherein determining tlic output video sample uses 
motion based interpolation. 

8. (Original) The method of claim 6, wherein determining the output video sample uses 
blended frames. 
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9-11 cancelled. 

12. (Original) The method of claim 1, wherein an input time determined for any output lime 
for a video sample is identical to an input time determined for the same output time for an audio 
sample. 

1 3. (Original) The method of claim 1 , wherein an input time determined for each output time 
for video samples is offset from an input time determined for the same output time for audio 
Scimplcs. 

14. (Currently Amended) The method of claim 1 , wherein the retiming function comprises a 
mapping of a plurality of video events in the input video data and a corresponding plurality of 
audio events in the inp ut audio data to a corresponding plurality of output times in the retimed 
clip. 

15. (Currently Amended) The method of claim [[9]] L further comprising computing a 
position curve for audio from the mapping, and wherein determining an input time from an 
output time for an audio sample uses the position curve. 

16. (Currently Amended) The method of claim [[10]] L further comprising computing a 
position curve for video from the mapping, and wherein determining an input time from an 
output time for a video sample uses the position curve. 

17. Cancelled 

1 8. (Currently Amended) The method of claim [[9]] i, further comprising receiving an 
indication of the mapping by: 

presenting a graphical user interface including a video track, an audio track and an output 

track; 
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receiving an indication of a video event in the video data on the video track through an 

input device; 

receiving ati indication of an audio event in the audio data on the audio track through an 
input device; 

receiving an indication of an output time in the retimed clip on the output track through 
the input device; and 

maintaining information indicating a correspondence between the indicated video event, 
the indicated audio event and the indicated output time. 

1 9. (Original) The method of claim 1 8, further comprising computing a position curve for 
audio from tlic mapping, and wherein determining an input time from an output time for an audio 
sample uses the position curve. 

20. (Original) The method of claim 1 9, further comprising computing a position curve for 
video from tlic mapping, and wherein detemiining an input time from an output time for a video 
sample uses the position curve. 

21 . (Original) The method of claim 18, further comprising computing a position curve for 
video from the mapping, and wherein detemiining an input time from an output time for a video 
sample uses the position curve. 

22. (Currently Amended) A computer program product, comprising: 

a computer readable medium; 

computer program instructions stored in the computer readable medium tlial, when 
executed by a computer, instruct the computer to perfomi a method for producing a retiming 
clTect on a clip of synchronized audio data and video Hnta, wherein the audio data comprises a 
siffpj^tnr^ nf a^^^ wherein each audio sample has a corresponding input time, and 

wherein 1^^^^^^ com prises a sequence of video samples wherein eac h video sample has a 

corresponding input time, to produce a retimed chp of synchronized audio data and video data in 
the audiovisual work , wherein in the retimed clip the audio data compr ises a sequence of audio 
sam ples wher e in eac h audio sample has a corresponding output time> an d wherein the video data 
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f^gmpr^^^^^^^^ samples wherein each video sample has a correspondini> oulput 

time, comprising: 

associating a definition of a retiming function for a rampable retiming effect lhat maps 
output limes to input limes with the clip of synchronized audio data and video data; 

processing the synchronized audio data and video data according to the retiming function 
to produce the retimed clip> wherein processing comprises: 
for each output time for an audio sample, 

determining a corresponding input time from the output time an^ using the 
retiming function; and 

computing an output audio sample at for the output time based on at l e a sHhe 
audio data in tlid^neigl^erhoo d of the coiTO o ponding input tim ^siftg^ b>Lgpjliym& ail 
aud.i.Q_i"csampliiig function to a pkiralitv of input audio samples from po i nts in time 
^irrnnnH]^^ input lime, wherein the audio resampling fimction 

nomhinex in formation from the plurality of input aud io samples to produce the oulput 
audio sa m ple; and 

for each oulput lime for a video sample, 

determining a corresponding input time from the output time using the 
retiming function, such that input times determined for output times for video samples 
correspond to input times determined for the same output times for audio samples; and 

computing an output video sample at for the output time based on at least th e 
videiv cteta4ft4l^eighbeFho o d o f the ee rrc o pond i ng input time u s in g by applying a video 
resampling function t o a plurality of input video samples from points in time surrounding 
thccorrespo ndin g in put time, wherein the video resampling function combines 
jnrnrmation from the plurality of input video samples to produ ce the output video sample. 

23. (Currently Amended) An editing system for editing an audiovisual work and for producing 
a rcliming effect on a clip of synchronized audio data and video data, wherein the audio data 
gnmpriscs a seq uence of audio samples wherein each audio sample has a corresponding inpu t 
tjmc, and w herein the video data comprises a sequence of video sam ples wherein each video 
sample has a coiTcspondine input time, to produce a retimed clip of synchronized audio data and 
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video dala in Ihc audiovisual work , wherein in the reti med clip the audio data comprises a 
ge^^iGncc of audio samples wherein each audio sample has a c orresponding output time, and 
yhfirnm jhn vidoo data com prises a s e quence of video sample s wherein each video sample has a 
correspond in o utput t ime, comprising: 

means for relating a definition of a retiming function for a rampable retiming eflect that 
maps output times to input times with the clip of synchronized audio data and video data; 

means for processing the synchronized audio data and video data according to the 
retiming function to produce the retimed clip, comprising: 

means for computing, for each output time for an audio sample, a corresponding 
input time from the output time and using the retiming function; 

means for compuling an output audio sample at for the output time feased-on-at 
least4t^audk>4ata-m4he^^eighbe rhood of the oorrooponding input time u sing-a by 
applying an audio resampling function to a plurality of input audio samples from points, 
ijijuTic surr ound ii^g the corresponding input time, wherciii the audi o resampling function 
mmhlncs info rmation from the plurality of input aud io samples to produce the output 
audio sample; 

means for computing, for each output time for a video sample, a corresponding 
input time from the output time and using the retiming function, such that input times 
determined for output times for video samples correspond to input times determined for 
the same output limes for audio samples; and 

means for computing an output video sample at for the output time fe a s ed o tvat 
lea&t4l^ video da^4tt4he- n cighborhoed-e f the corr es pond i ng input ti me^ng by 
app-lymg a video resampling function to a plurality of input v ideo samples from points jn 
tjmc surroun ding the conespondine input time, wherein the video resampling function 
combines infor mation from the plurality of input vid ^n samples to produce the output 
vide o samp le. 

24. (Currently Amended) An editing system for editing an audiovisual work and for producing 
a retiming effect on a clip of synchronized audio data and video data, wherein the audio data 
romptises a sequ ence of audio samples wherein each audio sample has a corresponding inp ut 
>jm^^nnd wherein th e video data comprises a sequence of vid eo samples wherein each video 
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campl£has n cnrres portdine innul time, to produce a retimed clip of synchronized audio data and 
video data in the audiovisual wr^r k. v^herein in the retim ed clip the audio data comprises a 
gp/jiit^nrifi nf audio samples wherein each audio sample has a c orresponding output time, and 
wliRi f^in the vide o data comprises a sequence of video sampl e s wherein each video sample has a 
correspondiii g output tim e, comprising: 

on editing interface allowing a user to associate a definition of a retiming function for a 
rampable retiming effect that maps output times to input times with the clip of synchronized 
audio data and video data; 

an audio retiming module having an input for receiving the definition of the retiming 
function and an input for receiving the audio data, and an output providing retimed audio data 
such that, for each output time for an audio sample, an output audio sample is computed using-a 
fesan^>Ung f»oetieivbased-^t^- lea st tho audio d ata in a neighborhood of a corres pendiw&wput 
time-aGeordi«g4e4l»e4'etWHftg^€tiefl hv a pplying a n audio resampling function to a plurality 
flljj^.CIllill'/iiO ^i^mplcs fr om points in time surround ing an input time mapped to the output time 
byJJl'lLI'Iij'n^ng/"'^^''"" - wherein the audio resampli ng function combines information from the 
plnrgliiy nf input audi o samples to produce the output audio sample ; and 

a video retiming module having an input for receiving the definition of the retiming 
function and an input for receiving the video data, and an output providing retimed video data 
such that, for each output time for a video sample, an output video sample is computed wsing-a 
fesampli¥>g func4ieH-based-e>ft-6t-t€as Uho video data in a neighborhood of a corrooponding 4«twt 
^■i„^a..,^^^..Amg.<o.)l^4:«^4mm(M:HB6t^ a pplvlng a video resampling function to a pluralilY_of 
jl'r?.'l:y.v!f?£j-5gil^P'g'' ^f"''" PQ^"'s in ti m e surround int? an input time mapped to the output time by 
the retiming function, w herein the video resamplin g function combines information from the 
r.l'Jj:?J.ily--nI Iim:*''' sam ples to produce the ou tput video sample, wherein input times 
dclcrmincd for output times for video samples correspond to input times determined for the same 
output times for audio samples. 

25. (Cuncntly Amended) A digital entertainment product, comprising: 
a computer readable mediuip; 
; information stored on the computer readable medium that, when read by a computer, 

indicates to the computer a retimed clip of synchronized audio data and video data, produced 
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according to a process for retiming a clip of synchronized audio data and video data, wherein the 
gi^iHin^jnla comprises a sequence of audio samples whe rein each audio samplp has a 
;iOr!!:^OrillU£-U21?^L^i"^g - and wherein the video data compri ses a sequence of video samples 
vyWfjn f^^^^ has a corresponding inout time, to produce [[a]] the retimed clip of 

synchronized audio data and video data in the audiovisual wnrW, wherein in the retimed clip the 
mulin fjnia comprises a sequence of audio samples whe rein each audio sample has a 
rntTn^pnnd^^^^ timc. and wherein the video data comprises a sequence of video sam ples 
wjirtrnij^ j^flch video sam ple has a corresponding output time , the process comprising: 

associating a definition of a retiming function for a rampable retiming effect that maps 
output times lo input times with the clip of synchronized audio data and video data; 

processing the synchronized audio data and video data according to the retiming function 
to produce the retimed clip, wherein processing comprises: 
for each output time for an audio sample, 

determining a corresponding input time from the output timc and using the 
retiming function; and 

computing an output audio sample at for the output time ba s ed on at lea s t th e 
audio-dativ in4he-neiehfeor4^e od of the corresponding input tim e u s ing a by applyinp an 
audicLrcsatnpling function to a plurality of input au dio samples from points in time 
siirrounding the corresponding input time, wherein the audio resampling function 
combines inrnrmal ion from the plurality of inpu t audio samples to produce the output 
aud io sam ple: and 

for each output time for a video sample, 

determining a corresponding input time from the output time and using the 
retiming function, such that input times determined for output times for video samples 
correspond to input times determined for the same output times for audio samples; and 

computing an output video sample at for the output timc based on a M e ast th e 
videe-daVa-ifv4he-!^ighbe rhood of the cor re spond ing input tim c u s ing by applying a yidco 
resampling function to a plurality of input v ideo sam ples from points in time sunoun cHng 
the correspondi ng input timc, wherein the video re sampling function combines 
jn jbnnati on from the plurality of input video samples to produ ce the output video sampjc. 
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26. (Currently Amended) In a system for editing an audiovisual work including a sequence of 
a pUualily of clips of audiovisual data, a method for producing a retiming effect on a clip of 
synchroni/.cd audio data and video Hata, wherein the audio data comprises a sequence of audio 
^Pjarl"^.— sam ple has a correspo nding input time, and wherein the video data 
PY^mi^n^cvQ a s^^^^^^^^ of vidco samplcs wherein ea ch video sample has a correspondinR input 
lime, to produce a retimed clip of synchronized audio data and video data in the audiovisual 
work, wherei n in the retimed clip the audio data com prises a sequence of audio samples wherein 
onrji niiHin Q^mplc has a corres ponding output time, and wherein the vidco data comprises a 
Knf^v^n^^c^ of video sa mples wherein each video sample h as a corresponding output time> 
comprising: 

associating a defmition of a retiming function for a rampable retiming effect that maps 
output times to input limes with the clip of synchronized audio data and video data; 

processing the video data of the clip according to the retiming function to produce a 

retimed video clip, wherein processing comprises: 

for each output time for a video sample, 

determining a corresponding input time from the output time aftd using the 
retiming function; and 

computing an output video sample at for the output time based on at least the 
video 4ata-in-the-neighbefhoe d of tho coiTe s ponding input tim e u s ing by applying a video 
resampling function to a plurality of input video samples fro m points in time surrounding 
^bj"J}P-ll^l^J?.Qn^iil£J^^^^^ w herein the video resampling function combines 
inrnrmaiin n from the pluralitv of input video samples t o produce the output video sample; 

placing the retimed vidco clip in the audiovisual work; and 

exporting the audiovisual work to an audio editing system, including the definition of the 
retiming function, for processing the audio data of the clip according to the retiming function, 
such that an input time determined for each output time for vidco samples corresponds to an 
input time determined for the same output time for audio samples. 
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27. (Currently Amended) In a system for editing an audiovisual work including a sequence of 
a plurality of clips of audiovisual data, a method for producing a retiming effect on a clip of 
syjichronizcd audio data and video riat a, wherein the audio data comprises a sequence of aud io 
smifilcs-whcn^ eac h audio sample has a corresponding in put time, and wherein the video data 
rnmpn^pc; a <!t^.qiience of video samples wherein eac h video sample has a corresponding input 
limc^ to produce a retimed clip of synchronized audio and video data in the audiovisual work, 
:!j]r.Lrj:!lrLl'^i:V 'y:^^^^^^^^ ^^^P ^"^'Q ^^^^ comprises a sequence of audio samples wherein each 
and KLsainplc has a corresponding output time, and w herein the video data comprises a sequence 
!?.LYAd!-ri gg'I"J'^^^ wherein each video sample has a correspond ing output time, comprising: 

receiving a definition of a retiming function for a rampable retiming effect that maps 
output times to input times associated with the clip of synchronized audio data and video data; 

receiving tlie audio data; 

receiving the audiovisual work including a retimed video clip processed according to the 
veliming function; 

processing the audio data according to the retiming function to produce a retimed audio 
clip, wherein processing comprises: 

for each o\itput time for an audio sample, 



audiojesampling function to a plural i ty of input au dio samples from points in time 
surrounding th e coiTCSponding input time, wherein the audio resampling function 
rnmhinn^ fr om the pluralitv of input audio samples to produce the outpu t 

audjo scimple; and 

synchronizing the retimed audio clip with the retimed video clip in the audiovisual work. 
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28. (Currently Amended) In a system for editing an audiovisual work including a sequence of 
a plurality of clips of audiovisual data, a method for producing a retiming effect on a clip of 
synchroni'/^d audio data and video dat a, wherein the audio d ata comprises a sequence of audio 
sginplcs whe rcin each audio sample has a corresponding in put time, and wherein the video data 
roim^^g^-'^ ^^q" ^"^<^ of video samples wherein each video sample has a correspondinR input 
timc^ to produce a retimed clip of synchronized audio and video data in the audiovisual work^ 
vvhnTmn in thn rctimcd cli p the Budio data comprises a seouen ce of audio samples wherein each 
gn jif^^nrnjilj^^^^ ou t put time, and wherein t he video data comprises a sequence 

!irjyi4gjg-g^^P-:ipI^^ ^^^h vi deo sample has a corresponding output time, comprising: 

receiving a definition of a retiming function for a rampable retiming effect that maps 
output times to input limes associated witli the clip of synchronized audio data and video data; 

receiving the video data; 

receiving the audiovisual work including a retimed audio clip processed according lo the 

retiming function; 

processing the video data according to the retiming function to produce a retimed video 
clip, wherein processing comprises: 

for each output time for a video sample, 

determining a corresponding input time from the output time aB4 for the retiming 
function, such that an input time determined for each output time for video samples 
corresponds to an input time determined for the same output time for audio samples; and 

computing an output video sample at for the output time ba se d o n at l e ast th e 
video <lat^-i»>t ho n o ighbo r-hoe<l-ef4 he correspon d ing input tim e usittg by applying a video 
resampling function to a plurality of in put video sample s from points in time surroundinft 
thecorrcspoiidjng in put time, wherein the video resampli ng function combines 
information fro m the pluralitv of input video samp les to produce the output video sample; 
and 

synchroni^ing the retimed video clip with the retimed audio clip in ihc audiovisual work. 
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29. (Currcnlly Amended) In a system for editing an audiovisual work, a method for defining a 
rcliming crfcct applied lo audio dala and video data^ wherein the audio data comprises a 
S^q^lia^l^L^J^fjl^jjiQ sample s wherein each audio sample has a corresponding input time, and 
vyhcrcinlhc video data comprises a sequence of video samp les wherein each video sample has_a 
gorrcsponding input time, to produce a retimed clip of synchronized audio and video dala in the 
audiovisual wor k, wherein in the retimed clip the a udio data comprises a sequence of audio 
Kgnipj^gg wherein each audio sample has a corresponding outp ut time> and wherein the video data 
comprises a sequen ce of video samples wherein each video sampl e has a corresponding output 
liijie, comprising: 

associating a mapping of a plurality of video events in the video data and a corresponding 
plurality of audio events in the audio data to a corresponding plurality of output times in the 
retimed clip; 

processing the audio data according to an audio resampling function that generates each 
output audio ^nmple.^ for each out put time for the retimed clip, from a plurality of input audio 
samples from points in time in the audio data surrounding an inp ut time mapped to the output 
linic, to produce retimed audio data , wherein the audio r esampling function combines 
information from the plurality of input audio samples to pr oduce the output audio sample; 

processing the video data according to a video resampling function that generates each 
output video sample, for each output time for the retimed clip, from a plurality of input video 
saniples from poin ts in time in the video data surrounding an input time mapped to the output 
tjmc^ to produce retimed video data , wherein the video resampling function combines 
mrornimion frorn the plurality of input video samples to produce the output video sample ; and 

placing the retimed audio data and retimed video data in the audiovisual work as the 
retimed clip of synchronized audio and video data. 

30. (Currently Amended) The method of claim 29, wherein processing the audio dala 
comprises 

computing a position curve for audio from the mapping; 
for each output lime for an audio sample, 

determining [[a]] the corresponding input time from the output time using the 
position curve; and 
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computing an output audio sample at for the output time based on a t - leas i4he 

audio^at^a•^B4l^t^igh: borhood of tho oorroGponding input time Ihe plurality of input 

gviHio sflmples from points in time surrounding th e corresponding input time using the 

audio resampling function. 

3 1 . (Currently Amended) The method of claim 30, wherein processing the video data 
comprises 

computing a position cui-ve for video from the mapping; 
for each output lime for a video sample, 

determining [[a]] the corresponding input time from the output time using the 
position curve; and 

computing an output video sample at for the output time based on at least th e 
vidc£vdala4ft4he-Heighbep hood of tho corresponding input tim e the pluraHty of input 
yi^rJl.?,§JIU:>l<^-^ fr om points in time surrounding the corres ponding input time using the 
video resampling function, 

32. (Currently Amended) The method of claim 29, wherein processing the video data 
comprises 

computing a position curve for video from the mapping; 
for each output time for a video sample, 

dcleiTnining [[a]] the corresponding input lijue from the output time using the 
position curve; and 

computing an output video sample at for the output time based on at-leas1^4^e 
video- data- khthe^eighbe rhood of tho co iTOSpendii^g4t^ut4ime the plurality of input 
y_idcg_samples f rom points in time ^nrmnndinp. the corresponding input time using the 
video resampling function. 

33. (Currently Amended) The method of claim 29, further comprising receiving an indication 
oflhc mapping by: 

presenting a graphical user interface including a video track, an audio track and an output 

track; 
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receiving an indication of a video event in the video data on the video track througli an 

input device; 

receiving an indication of an audio event in the audio data on the audio track through an 
input device; 

receiving cin indication of an output time in the retimed clip on the output track through 
the input device; and 

maintaining information indicating a correspondence between the indicated video event, 
tlie indicated audio event and the indicated output time. 

34. (Currently Amended) A computer program product, comprising: 
a computer readable medium; 

computer program instructions stored on the computer readable medium that, when 
executed by a computer, instiucts the computer to perform a method for defining a retiming 
effect applied to audio data and video data , wherein the audio data comprises a sequence of 
audio^ sarn pj wherein each audio sample has a correspondin g input time, and wherein the video 
d-lV?„C01Ln^ri5C^g^^ga^L^^^^^ samples wherein each video sa mple has a corresponding 

injlilLlimC-i to produce a retimed clip of synchronized audio and video data in the audiovisual 
worlc^ whr.rein in the re timed clip the audio data comprises a sequence of audio samples wherein 
r-n^^!l.gMUQ-Agn-iplc ha s a corresponding output time, and wherein the video data comprises a 
y.qngncc of vi deo samples wherein each video sample has a cor responding output timc> 
comprising: 

associating a mapping of a plurality of video events in the video data and a corresponding 
plurality of audio events in the audio data to a corresponding plurality of output times in the 
retimed clip; 

processing the audio data according to an audio resampling function that generates each 
output audio sample, for e ach output time for the retimed clip, from a plurality of input audio 
samples from points in time in the audio data surrounding an in put time mapped to the output 
tinic, to produce retimed audio data , wherein the audio resampling function combines 
"^XonilgllQ.q.fli^^lUbp^^^^^^ of in put audio samples to produce the output audio sample ; 

processing the video data according to a video resampling function that generates each 
output video sample, for each output time for the retimed clip, from a plurality of input video 
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samples from points in ti me in the video Haia snrroundin p an input time mapped to the output 
limc^ to produce retimed video Hat a wherein the video re samplinia: function combines 
ri^rn^mgijmi fm plurality of inout video samples to produce the output video sa mple; and 

placing the retimed audio data and retimed video data in the audiovisual work as the 
retimed clip of synchronized audio and video data. 

35. (Currently Amended) An editing system for defining a retiming effect applied to audio 
data and video data, wherein the audio data comprise -^ a sequence of audio samples whcreincach 
?i'LlL^lg.qimlg has a cor responding input time, and wherein th e video data comprises a sequence 
2LY!.^!r.O- a^l^npL^-'^^^^^ ^^^^ ^^^eo sample has a con-espo ndine input time, to produce a 
retimed clip of synchronized audio and video data in'lhe audiovisual work, wherein in the 
rH imc-H cWp the audio data com prises a sequence of audio samples wherein each audio samp l Q 
lias ji .^ovr^gpoEding outp ut time, and wherein the video data comprises a sequence of vid eo 
gfmiplesjv^^^ each vide o sample has a corresponding output time > comprising: 

means for mapping a plurality of video events in the video data and a corresponding 
plurality of audio events in the audio data to a corresponding plurality of output times in the 
retimed clip; 

rnccins for processing the audio data according to an audio resampling function that 
generates each output audio sample , for each output time for the retimed clip, from a plurality of 
input audio samples from points in time i n the audio data surrounding an input time mapped to 
the oul]iutj;Lme, to produce retimed audio data, wherein the audio resampling function combines 
i'2j!OJ2ngl'9JA ^LOI^^ ^^^^Q samples to produce the output audio samp jc; 

meajis for processing the video data according to a video resampling function that 
generates each output video sample , for each output time for the retimed clip, from a plurality of 
input video samples from poin ts in time in the video data surrounding^ an input time mapped to 
i!lc,ouiimt_tjiij_Q. to produce retimed video data , wherein the video resampling function combines 
inrnrmation from t he plurality of input video samples to produce the output video sample ; and 

means for inserting the retimed audio data and retimed video data in the audiovisual work 
OS the retimed clip of synchronized audio and video data. 
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36. (Currently Amended) A method for applying a rampable retiming effect to synchronized 
streams of tcrnponil media data, include a first stream of samples of a first media type wherein 
nyji^miiple has a corresp on ding input time, a nd a second stream of samples of a second media 
type different from the first media type, wherein each samp le has a corresponding input time, to 
produce a retimed cli p of s ynchronize d tem poral media data, w herein in the retimed clip each 
sg^mplc of the first media type has a co rres ponding output time and each sample of the second 
ijipdui type h as a corresponding output time , comprising: 

associating a retiming function for the rampable retiming effect with the synchronized 
streams, wherein the retiming function maps output limes to input times; 

processing the synchronized streams according to the retiming function, wherein 
processing comprises: 

for each output time for Ihe first stream, 

determining a corresponding input lime from the output time and using Ihc 

retiming function; and 

computing an output sample for the first stream al ior the output time frefti 
at-lea^t^ data-ifi-a^ffifghb orhood of the corre s ponding input time, us ing by applying 
a resampling function for the first media type to a plurality of input samples of the 
fi rst media type from points in time surrounding the corres ponding input time, 
wh erein the resampling function for the first media typ e combines information 
from the p lurality of input samples of the first media ty pe to produce the output 
sa mple of the first media type ; and 

for each output time for the second stream, 

determining a corresponding input time from the output time and using the 
retiming function, such that an input time delennined for an output time foj' a 
sample of the second stream corresponds to an input time determined for the same 
output times for a sample of the first stream; and 

computing an output sample for the second stream at for the output time 
FreH^t-leastH tota in a n e ighborhood of tho - corrosponding input t imermmg by 
ap^ixlO^ a resampling function for the second media type to a plurality of input 
sa mples of the second media type from points in time surrounding the 
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conx;s poncling input time, wherein the resampling fun ction for the second media 
typ e combines information from the plurality of inp ut samples of the second 
media type to produce the output sample of the second m edia type. 

37. (QuTcntly Amended) A method for applying a rampable retiming effect to synchroni7-cd 
streams of temporal media data, wherein the streams include a first stream of samples of a first 
media <ypft_wly;rein each sam ple has a corresponding input time> and a second stream of samples 
of a second media tvpa , wherein each sample has a corresponding input time, to prod uce a 
ro.iimRH clip o f synchronized temporal media data, wherein in the retimed clip each sample of the 
fii j;t modia ty pe has a corresponding output lime and each sample of the second media type has a 
corres p onding o utput time > comprising: 

associating a retiming function for the rampable retiming effect with the synchronized 
streams, wherein the retiming function defines a mapping of output times to input times, wherein 
the mapping has a corresponding temporal resolution of greater than or equal to a temporal 
rcsokuion of both of the synchronized streams; 

processing the synchronized streams according to the retiming function, wherein 
processing comprises: 

for each output time for the first stream, 

determining a corresponding input time from the output time and jyising the 
mapping defined by the retiming function; and 

computing an output sample for the first stream at the output lime frem 
aMeas^datarHn-a-neighbefhe od of the corresponding input time, usm g by appiyjng 
a resampling function for the first media type to a plurality of input samples of the 
first m edia type from points in time surrounding the corresponding in put time, 
wherein the resampling function for the first media type combines infoimation 
from the pl urality of input samples of the first media type to p roduce the output 
sampl e of the first media type : and 

for each output time for the second stream, 

determining a corresponding input time from the output time and using the 
mapping defined by the retiming function; and 
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computing an output sample for the second stream at for the output time 
froiB-at 4east- data in n noighbo rhe od of the oorrosponding i nput time, u sm% by 
ap pl ying a resampling function for the second media type to a plurality of input 
sameks of the second media type from points in tim e surrounding the 
correspondin g input time, wherein the resampling fun ction for the second media 
typ e combines information from the plurality of input s amples of the second 
nipdia ty pe to produce the output sample of the s econd media type. 

38. (Currently Amended) A method for applying a rampablc retiming effect to temporal media 
data synchronized with metadat a, wherein the temporal med ia data includes a sequence of 
5.?^VI\l^>yh\L^ltf.^g^^J^ sftmple has a corresponding input time , to produce a retimed clip, wherein 
the t r^i w^ r^ jipj^^^ seque nce of samples of temporal media data w herein each sample has 

a„corrcsponding outp ut time, comprising: 

associating a retiming function for the rampable retiming effect with the temporal media 
daln, wherein the retiming function maps output times to input times; 

processing the temporal media data according to the retiming function, wherein 
processing comprises, for each output time, 

determining a corresponding input time from the output time and using the 
rcliming function; and 

computing an output sample of the temporal media data at for the output time 
fronval-leasHen^ml^edia data in a n ei ghb orhood o f the co r respon dmg4nput'4^H^ 
using by app lyin g a resampling function for the temporal media data to.a plurality of 
i^npnj^samplcs of the tem poral media data from points in time surrounding the 
corresponding input time, wherein the resampling function for the temporal media data 
p^r^mhmg.^ jr^^^ from the plurality of input samples o f the temporal media data to 

lyndiKuH he output sample of the temporal media data ; and 
processing the metadata to synchronize the metadata with the retimed temporal media data. 
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